Tsallis Ensemble as an Exact Orthode 
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We show that Tsallis ensemble of power-law distributions provides a mechanical model of nonex- 
tensive equilibrium thermodynamics for small interacting Hamiltonian systems, i.e., using Boltz- 
mann's original nomenclature, we prove that it is an exact orthode. This means that the heat 
differential admits the inverse average kinetic energy as an integrating factor. One immediate con- 
sequence is that the logarithm of the normalization function can be identified with the entropy, 
instead of the q-deformed logarithm. It has been noted that such entropy coincides with Renyi 
entropy rather than Tsallis entropy, it is non-additive, tends to the standard canonical entropy as 
the power index tends to infinity and is consistent with the free energy formula proposed in [S. Abe 
et. al. Phys. Lett. A 281, 126 (2001)]. It is also shown that the heat differential admits the La- 
grange multiplier used in non-extensive thermodynamics as an integrating factor too, and that the 
associated entropy is given by ordinary nonextensive entropy. The mechanical approach proposed 
in this work is fully consistent with an information-theoretic approach based on the maximization 
of Renyi entropy. 
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After the pioneering work of Tsallis lj, nonextensive 
thermostatistics has been studied and applied to many 
diverse fields such as quantum information [2( and high 
energy collisions 0- Such a great success is mainly due 
to the fact that non-extensive thermostatistics proved to 
be a successful tool for studying a wide variety of com- 
plex phenomena, ranging from turbulence to astro- 
physics , which exhibit anomalous behavior character- 
ized by self-similarity and the emergence of power-law 
distributed events. Despite its success, non-extensive 
thermostatistics is not yet completely well founded. For 
example, important problems such as the definition of 
physical temperature of a system obeying Tsallis statis- 
tics 0, and whether it is necessary to use ordinary or 
normalized expectation values, are still under debate 0. 
Historically, in the literature of non-extensive thermo- 
statistics, the Tsallis ensemble of distributions is derived 
from the maximization of a generalized form of Shannon 
entropy (namely the so-called Tsallis entropy), subject 
to the constraints of the normalization and internal en- 
ergy. In this Letter, we shall address the problem of the 
foundation of Tsallis statistics from a different point of 
view whose roots can be traced back to Boltzmann him- 
self. The method, recently reviewed by Gallavotti ||, 
consists in checking whether the ensemble is an orthode, 
i.e., checking whether the heat theorem, 
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holds within the ensemble. The concept of orthodicity 
was developed by Boltzmann who placed it at the very 
foundation of the theory of ensembles in statistical me- 
chanics 8j. Unfortunately, this method seems not to 



have gained the same popularity like some other methods 
based on counting and information theory (also traceable 
back to the prolific scientific creativity of Boltzmann). 
Few important exceptions to this trend are represented 
by a couple of textbooks concerned with the mathemat- 
ical foundations of statistical mechanics |8|, |9| • 

The main contribution of this work is represented by 
the acknowledgement that Tsallis ensemble is an orthode 
(indeed an exact orthode) namely the integrating factor 
(1/T) exists and is equal to the average kinetic energy 
per degree of freedom, thus being in complete agreement 
with what happens within canonical, microcanonical and 
other standard ensembles. Quite surprisingly, though, 
the corresponding entropy is not given by Tsallis formula, 
but, as we shall see, a connection exists between the 
present approach and the standard nonextensive treat- 
ment. Questions concerning the heat theorem within the 
non-extensive framework have been addressed only very 
recently in Refs. ^1 an d ITU . The present contribution 
differs from that of Ref. [lOj in the sense that the Boltz- 
manian point of view has been adopted rather than the 
Gibbsian one in this Letter. The other main difference 
concerns the form of the distribution studied, which, in 
this Letter is implicitly defined in terms of the average 
energy E (see Eq. (JjJJ below), as it results from the Tsal- 
lis entropy maximization procedure Q. In th is resp ect 
the present work is much closer to the work bv lAbd 

In order to proceed to present the results, let us be- 
gin by reviewing the concept of orthodicity following 
Gallavotti's reconstruction of Boltzmann's original ar- 
guments ||. Consider a family (ensemble) of distribu- 
tions defined on the phase space of some Hamiltonian 
system, parameterized by a given number of parameters 
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Xi. For example the microcanonical ensemble is written 
as g(z; E, V) — ^^f^yy^-, an d the canonical ensemble 

is given by g(z; 8, V) — e z(py) • -^ et / ^ e tne num ber of 
degrees of freedom and the Hamiltonian be of the type: 



H(z;V) = ^ + <p(q; V), 



(2) 



where z = (q, p) = (q x , q 2 , ~qf,PuP2> — Pf) and V is an 
external parameter (for example the coordinate of some 
other body which interacts with the system, like that 
of a movable piston which performs work on gas con- 
tained in a vessel). To any external parameter, which 
can sometimes be named as "generalized displacement" , 
there corresponds a "generalized conjugated force" . For 
example, the pressure is taken to be the generalized con- 
jugated force corresponding to the generalized displace- 
ment called volume in particular. Here we shall assume, 
without loss of generality, that there is only one external 
parameter. Let us then define the macroscopic state of 
the system by the set of following quantities: 

E = (H) "energy" 

T = "doubled kinetic energy per degree of freedom' 

V = (V) "generalized displacement" 

P = (— "generalized conjugated force" 

where the symbol (•) denotes the average over the distri- 
bution p(z;Xi). The ensemble is said to provide a me- 
chanical model of thermodynamics, i.e., it is an orthode, 
if, for infinitesimal and independent changes of the Aj's, 
the heat theorem 



dE + PdV 
f 



exact dif ferential 



(4) 



holds. It is known, since the seminal works of Boltzmann, 
that the canonical and the microcanonical ensembles are 
orthodic (1H1|. 

Let us now consider the normalized Tsallis ensemble 
of power-law distributions Q: 



p(z;E,V) = 



l-£(H(z;V)-E) 



where 



N(E, V) = J dz 



1 



N(E, V) 



~(H(z;V) 
a 



E) 



(5) 



(6) 



is the normalization (partition function), and (3 is such 
that E satisfies the equation 



(H) = E, 



(7) 



as prescribed by the maximum entropy method and 
sometimes explicitly assumed in formal treatises of stan- 
dard statistical mechanics for the canonical ensemble . 



Note that Eq. implies that /3 = /3{E,V). For rea- 
sons of simplicity, we introduced the parameter a which 
is related to the nonextensivity parameter q via the fol- 
lowing relation a = . The limit q — * 1 corresponds to 
the limit a — > oo. Note that in Eq. (J5J we adopted the 



power law index a — 1 
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i.e. we are using the escort 



distribution to evaluate averages. Let us now introduce 
the following quantity: 



Af(E, V) = d 



1 



-(H(z;V) 

a 



E) 



(8) 



Then it is straightforward to see that the ensemble given 
by Eq. ^ is an orthode, and the associated entropy is: 



S(E,V)=logAf(E,V), 



namely 



dS 



dE + PdV 
f : 



(9) 



(10) 



where E, V, P, T are defined according to Eq. @ as av- 
erages over the Tsallis ensemble |JS). Before proceeding 
to the proof, let us recall two known facts 0. First, Eq. 
implies that 



Af(E,V) = N{E,V) 



(11) 



Second, there exists an equipartition theorem associated 
with the ensemble |JSJ| according to which 
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(12) 



This can be easily proved via integration by parts, using 
the cut-off condition according to which the distribution 
is null over the region 1 — (3(H — E)/a < and using Eq. 
(Ill|l 13]. An immediate consequence of the equipartition 
theorem is that: 





In order to prove orthodicity, we write: 



(13) 



dN 
~dE 



d_ 
~dE 



dz 



= / d 







l-HH-E) 



90 , 



.df3 



-N-^(H-E)+Nf3 = Af(3 



T 



-0 
(14) 



and 

dN 
W 



d_ 

dV 



1--{H-E) 



1 - 



0{H - E) 



d/3 



dB 

(E — H) — N/3 



dH\ P 
w )=N0P = N- (15) 
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so that: 



dS 



dM _ dE + PdV 
AT ~ T 



(16) 



This shows that Tsallis ensemble provides a mechani- 
cal model of thermodynamics ||, in the sense that the 
mechanical quantities < H >, 2 < K > //, V, and 
— < dH/dV >, evaluated over the escort distribution, 
are related to each other according to the prescriptions 
of thermodynamics. One immediate and quite surpris- 
ing consequence is that log M has to be identified with 
entropy, instead of Tsallis entropy. 

Quite interestingly the property of orthodicity can be 
proved also by adopting a slightly different point of view, 
namely by considering the ensemble (J5J, as parameter- 
ized by (/3, V) rather than (E, V). This means that for 
each fixed (/?, V), E is chosen in such a way as to be the 
solution of Eq. Q. Therefore E, and consequently also 
N and M, are considered as functions of (/?, V). In this 
case one has: 



dN 
~df3 



d_ 

dp 



dz 



l--(H-E) 
a 



-N(H - E) +NP 



dE _M dE 
~dp ~ ~T~dp 



(17) 



and 



dM 

w 



_d_ 

dV 

= f dz 



dz 



1 - 







H — E) 



P{H - E) 



at-l 



p dV P dV 



P dV P \dV I T \dV 



so that: 



but dE 



dS = 



dM _ §dp + $dV + PdV 
M ~ T 



P (18) 



(19) 



dE 

9/3 



dp 



If dV. Therefore: 



dS = 



dE + PdV 
f 



(20) 



This feature can be thought of as a duality property 
which the Tsallis ensemble (0) does not share with the 
canonical and microcanonical ensembles. Further it sug- 
gests that the Tsallis ensemble could be thought of as a 
hybrid ensemble, placed half the way between the canon- 
ical and the microcanonical ensemble. 

A few comments on the main result proved above are 
in order. These concern few fundamental issues posed by 
non-extensive thermodynamics, namely whether canon- 
ical results are recovered in the a — > oo, whether the 



ensemble JJJJ, and the corresponding entropy are 
suitable for describing small dimensional systems and 
whether the entropy © is additive. We shall discuss this 
in relation to the standard orthodic ensembles, namely 
the microcanonical and the canonical one. Finally we'll 
establish a connection between the the non-extensive en- 
tropy, based on information theory, and the present treat- 
ment based on the heat theorem. 

Let us begin with the recovery of canonical results. 
Thanks to the well known properties of the q-deformcd 
exponential [l4j |. in the limit a — > oo, the expression of 
entropy given by Eq. ©, recovers the standard entropy 
of the canonical ensemble |9J|: 



lim log TV = log / dze 



" M 11 =pE + \og I dz, 111 

Note that in this limit one has N = Af = e@ E Z, where 
Z is the canonical partition function. Therefore N is not 
really the q-counterpart of Z 7 this is the reason why we 
didn't keep the established notation Z q and introduced 
the N notation instead. 

It is easy to see that if the canonical entropy is ad- 
ditive thanks to the factorization of the exponential 
( e -/3(ffi+ff2) = e -PH le -f3H 2 ^ the entropy m Eq. JSJ, 

is not, because the power-law does not factorize. There- 
fore, despite the logarithmic structure, the entropy © 
is suitable for describing non-additive systems. In this 
respect it is fair to stress a simple fact which is often 
overlooked, namely that the entropy associated with the 
microcanonical orthode 



S fi (E,V) = log f 



dz (22) 

{(z;V)<E 

is itself non-additive ^5|. This is to stress that a log- 
arithmic structure does not ensure by itself additivity, 
even within a standard ensemble, such as the micro- 
canonical one. Both Tsallis and microcanonical ensemble 
are potentially good in describing non- additive systems, 
whereas the canonical is not. 

In our view, it is very important to stress that Eq. i|ltj|) 
holds independent of the number of degrees of freedom 
of the system, i.e., the ensemble {JjJ is an exact orthode 
[l2j |. In sum, the main result found here states that the 
Tsallis ensemble provides a mechanical model of equilib- 
rium thermodynamics of non-additive and possibly small 
systems. We must stress that exact orthodicity is not 
an exclusive feature of the Tsallis ensemble, for exam- 
ple Boltzmann knew that the canonical orthode is exact, 
and recently it has been stressed that the microcanoni- 
cal orthode is exact too 12j. Therefore, in principle all 
three ensembles are potentially good in describing small 
dimensional systems. It is also worth stressing that the 
result proved above holds for generic Hamiltonians, with- 
out restriction to ideal non-interacting systems. 

It is useful to stress that, due to orthodicity, namely 
the fact that standard thermodynamic relations exist 
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among the quantities E, P, T, V, S, one can construct the 
thermodynamic potentials as usual by means of Legendre 
transforms. For example the free energy will be given by: 



E -TS = E -T log M 



(23) 



This is in complete agreement with the results of Ref. |6( 
(compare with equation (29) therein), derived from the 
requirement that the free energy should be expressed as 
a function of the physical temperature Here, the 

same result has been obtained by adopting Boltzmann's 
general method, namely by proving that the heat theo- 
rem holds within the Tsallis ensemble. This approach is 
a very fundamental and unifying one. Thanks to Boltz- 
mann's concept of orthodicity, Tsallis ensemble has been 
framed within the general theory of statistical ensembles 
beside the microcanonical and the canonical ones. To 
better ap prec iate this unifying feature, the reader is re- 
ferred to |12J, where a proof, very similar indeed to the 
one presented here, of the orthodicity of the microcanon- 
ical ensemble is offered. 

Let us now focus on the connection of this work with 
the standard information theoretic approach where the 
leading role is played by the Tsallis Entropy. It is quite 
simple to show that, for any strictly monotonic C 1 func- 
tion g (x), the quantity Afg'(J\T)P is an integrating factor 
for dE + PdV and the associated entropy is = g{M). 
In fact, using Eq. (f 14ft and 1)15(1 would lead to 



dS {9) = Ng\N)f3{dE + PdV). 



(24) 



Adding the condition that the integrating factor be the 
average kinetic energy, i.e., (3, leads us to Ng'(N) = 1, 
which brings back to the logarithmic entropy S — logJ\f+ 
const. On the other hand, adding the condition that the 
integrating factor equal the Lagrange multiplier used in 
the Tsallis maximization procedure, which in our nota- 
tion would read (3l — (3M x l a , leads to the Tsallis entropy 
form: 

S q [M) = a{N 1/a - 1) + const = In, N + const (25) 

where the symbol ln 9 indicates the q-deformed logarithm 
El. Therefore 



dS q = p L SQ 



(26) 



This fact has been acknowledged very recently also in 
|llj | . The present approach makes evident that the quan- 
tity SQ — dE + PdV admits infinitely many different in- 
tegrating factors associated with as many entropies and 
that the Tsallis entropy is the one associated with the 
integrating factor (3l- Therefore, adopting the Tsallis en- 
tropy, although the integrating factor would not coincide 
with the average kinetic energy, the thermodynamic rela- 
tions would still keep holding. Nonetheless the fact that 



the Lagrange multiplier (3l does not have such a straight- 
forward physical interpretation as the quantity (3, poses 
some questions regarding the physical interpretation of 
the associated entropy l|2*5^l too. On the contrary, the 
fact that the logarithmic entropy S = log Af is associated 
with the physical temperature i.e., 



dS = (38Q 



(27) 



makes it the ideal candidate to play the role of physi- 
cal entropy or Clausius entropy within the non-extensive 
framework. 

The fact that the present mechanical approach to 
non-extensive thermodynamics does not lead to the 
Tsallis entropy, is not an indication that an alterna- 
tive information-theoretic approach, consistent with the 
present, is lacking. Indeed it is quite easy to prove that 
the logarithmic entropy © , is equal to the Renyi entropy 







log J dzir(z) 



(28) 



of the ordinary distribution: 

\-£(H(z;V)-E) 



n(z;E,V) 



M(E,V) 



(29) 



where E is the average energy evaluated over the nor- 
malized distribution p (JSJ. This fact follows straightfor- 
wardly from Eq. 1)11(1 . the identity 



n(z;E,V) 



i _ 



l-&(H(z;V)-E) 



Af(E,V)* 



(30) 



and remembering the relation a = 1/(1 — q). 

Conversely it is easily seen that the distribution 1(29(1 . 
is obtained from the maximization of the Renyi entropy 
under the constraints: 



dz7r(z) = 1 
/ dzn(z)*H(z) 



J dz7r(z)<? 



E 



where the latter is evidently in accordance with the re- 
quirement that the average energy should be evaluated 
over the normalized distribution p. The maximization 
procedure shows that the quantity (3, namely the inverse 
physical entropy, coincides with the Lagrange multiplier 
associated to the constraint on the average energy in this 
case. 

To conclude, we have shown that Tsallis ensemble is an 
exact orthode, whose associated entropy is the logarithm 
of the normalization function, namely Renyi entropy. As 
expected such entropy recovers canonical one and it is 
non-additive. Further the result holds for small system 



(exact orthodicity), where the interaction (f(q; V) is not 
neglected. All this can be summarized by saying that 
Tsallis ensemble provides a mechanical model of nonex- 
tensive thermodynamics for small interacting Hamilto- 
nian systems. The present mechanical model based on 
the power-law ensemble leads to Renyi entropy, whose 
maximization, in turn, leads back to the power-laws, thus 
preserving the the two-fold foundation (i.e. mechanical 
and informational) typical of canonical ensemble. 
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